_A bi-monthly publication of the 


Christian Medical Commission World Council of Churches 
150, route de Ferney 1211 Geneva 2 Switzerland 


The Patna experience 


INTRODUCTION 


Just as community-based health development 
requires the people themselves to become the 
central characters in their programme activities, 
participatory evaluation involves people in an 
assessment of the strengths and weaknesses 
of their own programmes. In the process, the 
participants teach themselves and each other 
how they can improve their contribution to the 
future success of their work. 


Crucial to the approach is a recognition and 
respect for local knowledge and for the wealth 
of local experience. Participatory evaluation 
gives people an opportunity to review and 
judge their own contribution to activities, and 
provides them with the knowledge and the 
confidence to play a fuller part in community 
decision-making. 


Thirteen years ago, Contactpublished an issue 
on the theme of "Participatory evaluation - An 
appropriate technology for community health 


programmes" (Contact 55, February 1980). 


The issue created considerable interest among 
readers, many of whom were keen to learn 
more about how to compare the achievements 
of their programmes with what they had hoped 
for and planned. 


Some years later, Marie-Thérése Feuerstein, 
the author of that issue, suggested a follow-up 
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Health workers use locally-made cards to evaluate the school 


health component of their programme in urban and rural areas. 
Photo: Marie-Thérése Feuerstein 


"to share some of the process and findings of 
a participatory evaluation." We publish her 
contribution in this issue. The example chosen 
is that of an evaluation by the participants of a 
community health programme in Patna, in the 
Indian state of Bihar. 


The Patna experience provides a story of 
success in participatory evaluation. It shows 
how the process of evaluation itself helped 
motivate social action in poor communities. 
We have also been able to show that the 
evaluation has had a sustained impact. Earlier 
this year, four years after the evaluation was 
completed, we received arepontof the individual 
and group achievements within the community 
served, and of the continuing strength and 
enthusiasm of the Kurji Holy Family Hospital's 
community health team. We are delighted to 
be able to share it with our readers. 


In some cases, as in the example offered in this 
issue of Contact, an outsider acts as a facilitator 
in the participatory evaluation process. This is 
not always necessary. Community health 
workers with experience or training in 
participatory evaluation may themselves have 
the skills to facilitate the process. 


Ideally, every community health programme 
should include ongoing participatory evaluation. 
In fact, the earlier the evaluation process is 
introduced, the better the chances for the 
programme’s future success and effectiveness. 
Without regular, planned monitoring and review, 
many communities and health workers become 
so totally involved with day-to-day activities 
that they find it difficult to make time to reflect 
on whether they are continuing to move in line 
with their original vision and objectives. 


All programmes benefit from reflection and 
criticism - both of self and of others - and that 
is what participatory evaluation ensures. Here 
at CMC, we are busy extending our monitoring 
and evaluation activities. How about you? 


PARTICIPATORY EVALUATION: 


The Patna Experience 


By Marie-Thérése Feuerstein“ 


A community health and development team working in the poor, heavily-populated Indian state of 
Bihar has found new direction, and a new level of commitment from the community, as a result of 
incorporating participatory evaluation into their expanding programme. 


On the banks of the Ganges river at Patna, 
north-eastern India, stands the Kurji Holy Family 
Hospital. It is a 275-bed teaching hospital 
serving Patna, the capital of Bihar, the second 
most populous state of India. 


For more than 30 years, the hospital has run a 
- community health programme with the aim of 
reaching out to the poorest in the surrounding 
area. An estimated two-thirds of the population 
of Bihar are living below the poverty line. Twenty 
per cent of the state’s population in 1988 were 
comprised of tribal people and Harijans or 
"untouchables", who now refer to themselves 
as Dalits. 


The poverty in Bihar has little to do with the 
quality of the land. Bihar is made up of fertile 
plains, and the southern plateau of the state 
provides 40% of India’s minerals. The lack of 
development has more to do with the meagre 
industrial development and the neglect of the 
state's infrastructure. Farmers have to manage 
without roads and power supplies, let alone the 
benefits of modern agricultural technology. 


The unequal distribution of land is another 
serious barrier to progress. Most of the 
cultivated areas produce zero or low growth 
due to poor irrigation and lack of modern inputs 
and extension services. Wealthy landlords 
continue to own huge tracts of land but offer 
little support to those they leave to work on their 
estates. The remaining cultivable land is divided 
into plots which are often too small to be 


“Marie-Thérése Feuerstein, is author of Partners in 
Evaluation, (see Useful Publications, page 16). 


efficient. Most of the tribal and Dalit families are 
landless. They are forced to hire themselves 
out, mainly as farm labourers, on a daily basis. 


Community health 

The Kurji Holy Family Hospital decided to start 
using a room in the hospital as a community 
health department in 1959. The aim was to 
familiarise staff with the conditions of the poor 
living in peri-urban areas of Patna. By 1968, 
the department had its own Urban Health 
Centre in a separate building in the hospital 
grounds. 


A year later, a request from a priest working in 
a particularly poor, rural area 21 km from the 
hospital heralded the start of an outreach 
programme. He requested weekly clinics for 
the people of Maner, an area extending 
westward along the Ganges. The workin Maner 
flourished, and in 1978, the Maner Community 


Photo: A. Heyman/UNICEF 


The community health programme reaches out to the poor in the 
Patna area of the Indian state of Bihar. 
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Health Centre was built by the Catholic Medical 
Missionaries. 


Since then, the programme has increasingly 
emphasised social development. A number of 
community workers are employed in what is 
now a multidisciplinary team.. 


THE EVALUATION PROCESS 


1 Deciding to evaluate 

Prior to the participatory evaluation, there had 
been several earlier efforts in studying the 
progress of the programme. One was under- 
taken in 1976 by a hospital management team, 
and another by the Voluntary Health Association 
of India (VHAI) in the early 1980s. VHAI recom- 
mended better definition of target areas, more 
preventive and promotive health services, such 
as for tuberculosis and leprosy, and a greater 
emphasis on maternal and child health (MCH) 
care. At that time, men - as the workers and 
income-earners - were shown considerably 
more attention from the health services than 
that received by their wives and children. 


A few years later, two members of the 
community health department staff attended a 
seminar on social analysis and began to feel 
that the programme needed to focus even 
more intensively on the poorest people in the 
communities. The participatory approach 


Irrigation systems along the Ganges river often deteriorate 
through neglect. 
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interested these two individuals. It was an 
approach which made reaching the poorest a 
priority, and which involved health workers, 
and the community, in making their own 
evaluation and their own recommendations for 
adjustments to the programme. 


However, to most of the members of the health 
staff team, the idea that they were to evaluate 
the programme for themselves seemed 
ambitious. They had very little baseline data, 
and some of the community health workers 
(CHWs) and community development workers 
(CDWs) were unable to read or write. 


Finally, the team invited Marie-Theérése 
Feuerstein, a facilitator in "participatory 
evaluation” to come and visit them to explain 
the process. The visit was made possible 
through funding from the programme’s partner, 
Misereor, Germany. 


In Patna, the facilitator described to the health 
team how each of them - whatever their 
background - would be able to participate in an 
evaluation of their programme. They soon 
became convinced that they would like to adopt 
such an approach, and together set dates for 
her return. 


2 Defining the objectives of the evaluation 

and choosing evaluation methods 
Six months later, in October 1988, the 
evaluation facilitator returned to Patna to 
join the 20 members of staff working in the 
community health and development team. 

Half of them were based at the Urban 
Health Centre Kurji and the other half at the 
Maner Community Health Centre. The 
intention was to evaluate the progress of 
the past four years (1984-1988). 


The first event was a six-day training 
workshop (see box on page 6) to plan and 
prepare for the evaluation. 


The first task was to define the objectives of 
the evaluation. All were agreed that the 
main objective of the programme as a whole 
was to help people meet more of their basic 


needs. The problem then was how to measure 
progress towards this objective. 


The facilitator asked the team to think about 
the life conditions that were influencing the 
health and social development of families in 
the communities they aimed to serve. From a 
primary focus of looking at family needs, 
participants then "scaled up" to look at 
community needs. They drew up alist of factors 
affecting health development, including 
education, food, housing and so on. 


When discussion moved specifically to health 
needs, each requirement that was mentioned 
was drawn on the blackboard forming a 
primary health care circle around a family 
_ group (see drawing on page 5). The team 
discussed the links between achieving the 
components in the primary health care circle 
and achieving other basic needs. 


The list of conditions affecting people's health 
and lives provided "indicators" or markers for 
measuring progress (see box) indifferent areas. 
For example, an increase in the "percentage of 
people living in good quality homes" would 
constitute progress in living conditions. 


In order to measure changes in the indicators 
of progress, the team realised that there were 
"key" questions which needed to be answered 
in order to establish whether components of 
the programme were successful or not. For 
example, how extensive was their health 
programme and had it improved the health of 
schoolchildren? Questions were decided upon 
for the four main activity areas of the 
programme, namely, for health activities, 
social support activities, programme orga- 
nization and management, and training. 


Next, the team worked out how to collect the 
information. They decided on nine main 
evaluation methods: 


. Analysis of records and documents 

. Survey of maternal and child health from a 
sample of women aged 15-49 years 

. Mid upper-arm circumference measurement 
of children aged 1-4 years 


Why indicators are important 


An indicator is a marker. It can be 
compared to a road sign which shows 
whether you are on the right road, how far 
you have travelled, and how far you still 
have to go in order to reach your 
destination (or objective). Indicators show 
progress and help to measure change. 


4 SIGE. 
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Many indicators consist of measurements 
and are expressed in numbers, such as: 


_ a percentage (part of a total), such as 
50% (half) of the farmers in a village use 
chemical fertilizers. 


. arate, such as the infant mortality rate, 
which is the number of children under 
one year who die in a year, in relation to 
1,000 live births in that same year. (lt 
may help to think of arate as the speed 
at which something occurs, as well as 
the amount.) 7 


. aratio, such as the number of teachers 
in relation to the numbers of children in 
primary schools in a specific area (for 
example, one teacher to twenty 
children). 


Source: Partners in Evaluation (for details, see 
page 16). 
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The participatory evaluation process 
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Evaluation is like a turning wheel. The wheel should never be broken by omitting one 
of the stages or by excluding programme participants from any part of the process. 


Deciding to evaluate 
Defining the objectives of the evaluation and choosing evaluation methods 
Preparing and pre-testing the evaluation methods or "tools" 


Collecting new information using the evaluation tools and selecting existing 
information (data) to evaluate the programme 


Analysing the data collected, reaching conclusions ("findings") and producing 
recommendations 


Preparing the report in forms suitable for sharing with various groups 
Sharing the findings of the report 


‘Putting the recommendations into practice in the on-going programme. 


4 Contact 


| 
ao: 


. Flash cards, weight-by-height chart and 
puppetry for school children 

. Village meetings and Focus Group 
Discussions 

. Special staff meetings 

. Group questionnaire on community health to 
nursing and midwifery students 

. Observations 

. Visits to key informants. 


The team also had to delegate responsibilities, 
to decide the sequence in which evaluation 
preparation, implementation and analysis would 
take place, and to make plans about how to 
present and use the evaluation results. In all, it 
took the team two-and-a-half days of the six- 
day workshop to complete the detailed plan. 


3 Preparing and pre-testing the evaluation 
methods or "tools" 
Another two days of the workshop were devoted 
to training, and designing and developing the 
evaluation tools. The health centre staff, 
including CHWs and CDWs, and students were 
trained in interview techniques. Everyone also 
had to learn how to organize Focus Group 
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Discussions and to understand how to develop 
the "tools", such as the model for the survey 
forms. 


To obtain the additional MCH information 
needed, a three-page questionnaire was 
prepared for the survey. The questionnaire 
was then pre-tested on a random sample of 
mothers attending the community health 
department’s Urban Health Centre at the 
hospital site in Kurji. 


It was decided that focus group discussions 
should be held with those involved in milk 
cooperatives, for example, to find out what had 
been achieved. The focus group discussions 
involved a team member acting as facilitator to 
steer a discussion. He or she would have 
prepared several key questions in advance, 
and the discussion provoked by the questions 
would identify factors that had contributed to or 
impeded success. 


Preparation of a number of evaluation tools 
were necessary for the evaluation of the primary 
school programme. For example, in order to 
check for physical development, Save the 
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Forming a primary care circle 
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Children Fund weight-for-height charts were 
made more durable by sticking red, green and 
yellow insulating tape onto the different bands 
(see photograph). Strips of X-ray film had to be 
cut and strategically coloured to measure the 
mid upper-arm circumference of the children. 
In order to evaluate the health education 
programme in the schools, team members 
produced sets of hand-drawn and painted flash 
cards. These would be used to test how much 
the children understood about the links between 
health and hygiene as a result of the health 
education they had received. Staff also made 
puppets which they would use to entertain the 
children and communicate specific health 
information after a particular evaluation session 
had been completed. 


The aim of the workshop (see sections 2 

and 3) was to: 

. decide on the objectives of the 
evaluation 

. select the "indicators" of progress 

. decide on evaluation methods 

. Make an evaluation plan around the 


objectives 

. decide how to present and use 
evaluation results 

. train the evaluation team in interview 
methods 

. prepare evaluation methods or "tools". 


4 Collecting new information using the 
evaluation tools and selecting existing 
information (data) to evaluate the 
programme 

As mentioned earlier, the four components of 

the programme are health activities (A), social 

Support activities (B), organization and 

management (C), and training (D). 


Each member of the evaluation team took 
responsibility for collecting the data in one of 
these four areas of activity. The questions 
relating to the different components had already 
been discussed and agreed upon during the 
evaluation workshop. 
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Evaluation included asking mothers to answer a questionnaire. 


A) Health activities 


Maternal and child health 

Many of the activities of the Urban Health 
Centre at Kurji and the Maner Community 
Health Centre in the rural area catered to 
mothers and small children. There was there- 
fore aconsiderable amountof information (data) 
available. For example, analysis of some of the 
programme records had indicated that few 
women were receiving antenatal care. At the 
evaluation planning workshop, all were agreed 
that the most important questions in the 
evaluation would relate to achievements and 
shortcomings in maternal and child health. 


The team decided to use a Survey as a major 
evaluation tool. This was not initially an unani- 
mous decision. Some team members, and 
even the facilitator herself, would not necess- 
arily have chosen to undertake a survey as the 
major evaluation tool. The facilitator felt that 
the process could be too time-consuming within 
the overall evaluation, and that more active 
participation of villagers with poor literacy skills 
might be achieved by focus group discussions. 
However, other team members felt that a survey 
would not only raise awareness in the villages 
but also help team members themselves to 
strengthen their own survey and evaluation 
skills. 


The survey sample included a total of 441 
women aged 15-49 years. They were inter- 
viewed in the health centres, villages and at 


work in surrounding fields. Over half the women 
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Drawing: Partners In Evaluation 


Measuring mid upper-arm circumference of children aged 
1-4 years was another evaluation method. 


were aged 22-30 years and approximately 
three-quarters of them were living in the target 
area for programme activities. 


_ The interviewers reported that they were well- 


received by mostof the village women. Although 
some women were reluctant at first to answer 
questions because there were no free hand- 
outs, most offered their time willingly. Some 
women even said that they liked being asked 
questions. They said it gave them an opportunity 
to think about aspects of their lives that they 
had not considered before. For example, they 
were particularly interested in talking about the 
dowry system and about their own experiences 
of marriage and pregnancy. ) 


The interviewers reported that carrying out the 
survey had helped them get to know the women 
better. "| was surprised that village women 
were prepared to answer questions,” said one 
member of the team. "Even our male 
interviewers found that the women were 
cooperative and very willing to discuss openly." 


School health 
Of the 29 schools involved in the programme’s 


health activities, three were selected for 


evaluation - two in urban areas and one ina 
rural area. 


The sets of hand-drawn flash cards were used 
by the evaluation team to assess the children’s 
knowledge of three common health problems, 
namely, diarrhoea, scabies and eye infections. 


The team decided that they also wanted to 
build new skills into their school health 
evaluation "package". They therefore 
introduced aspects of the Child-to-Child 
approach as part of the evaluation. In the 
Child-to-Child method, older children "spread 
health messages to younger children, peers, 
families, and communities". (See Contact 121 
on Children). 


Teachers helped to identify students who would 
work with the evaluation team and become 
"key actors" in the evaluation. These older 
children weighed and measured the younger 
pupils, using the weight-for-height chart. 


The final part of the school health evaluation 
provided an opportunity for the children to 
improve their health knowledge. Members of 


Measuring weight-for-helght using the 
Child-to-Child approach 
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the team used their hand-made puppets to 
present a story. The puppet characters were 
based on those the children had seen in the 
flash cards. In telling the story, the puppets 
answered the questions which the children had 
been asked during the evaluation. In this way, 
the children enjoyed themselves and had the 
opportunity to learn all the right answers to the 
questions they had been asked while being 
shown the flash cards. 


B) Social support activities 


A second area of programme activity was the 
social development programme which had 
started two years earlier. The activities included 
assistance to local people in taking advantage 
of government welfare : 
schemes, support for 
cooperatives, lobbying 
work with bonded 
labourers and encour- 
agement for youth 
drama and women’s 
activities. During the 
evaluation planning, 
the team had decided 
to use focus group 
discussions to evaluate 
these activities. This 
was partly because 
focus group dis- 
cussions allowed fuller 
participation of those 
who could not read and 
write and partly because there was no baseline 
income data on which to base a survey. 


health education. 


Government Welfare Schemes 

Focus group discussions with villagers during 
the evaluation revealed that, in the words of 
some villagers: "Government tries to give 
people good quality - but they end up getting 
bad quality." 


The main problem appeared to be that even 
when people did manage to receive food or 
livestock through the schemes, they were some- 
times of poor quality or inappropriate to the 
family’s needs. For example, the grain given in 
return for work on roads, construction of schools 
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A puppet play amused the children and provided them with 


and social forestry, was often sub-standard. 
The goats supplied on loan were often sick or 
producing very little milk. Families were not 
always trained to handle the items or animals 
they received, for example, to drive a horse 
and cart. Some families felt that they had 
actually become poorer, as they had the added 
burden of loan repayment. This was particu- 
larly true in cases where their animals had 
died. 


Another problem was that obtaining a loan was 
made difficult by the corruption among local 
officials and local bank clerks. Families were 
often asked for bribes of 10% or more of the 
loan, and the bank officials receiving the 
advance would take their own share before . 

releasing the money. 


Milk cooperatives 

One of the three milk 
cooperatives estab- 
lished through the 
programme had 
produced considerable 
benefits for the 52 
members _ involved. 
Focus group discussion 
revealed that average 
family income of the 
members had risen well 
above the average. 
Motivation for adult 
education and literacy 
| had increased through 
having to keep accounts and write business 
letters. Having the status of a registered body, 
it was also easier for the members of the milk 
cooperative community to apply for government 
schemes. As a result, they were planning to 
start poultry farming, a fair-price shop and a 
pre-school for young children. 


However, two other milk cooperatives had 
failed. They had run into financial and 
management problems because too few people 
had adequate business skills. 


Bonded labourers 
During the focus group discussion, it emerged 
that 600 bonded labourers had organized a 


rally about their situation to present their case 
to state-level officials. The programme had 
started to support the activities of these men 
because of the extreme deprivation of life as a 
bonded labourer. 


Youth drama 

Evaluation of the youth activities of the 
programme was hampered because the youth 
group had not yet been re-formed. Unfortu- 
nately, a misappropriation of funds had 
occurred leading to a loss of public support and 
eventually to the group being disbanded. 


Women’s activities 

With funds from a government scheme, the 
programme had helped 25 Dalit women to 
attend a three-month training for self- 
employment. The evaluation revealed, through 
focus group discussions, that although some 
women had initially succeeded in self- 
employment schemes, such as making and 
selling fans, they had later run into difficulties in 
buying raw materials. 


C) Programme organization and management 


The process of evaluating the programme’s 
Organization and management comprised 
mainly of drawing together existing information 
(data) that would be needed for the overall 
- evaluation analysis. For example, it was 
necessary to prepare details of programme 
costs and expenditures, information about 
target areas and about arrangements for 
programme monitoring and networking. 


D) Programme training 


Although the programme had trained a 
diverse range of personnel including dais or 
traditional midwives, community health 
workers, and government workers, such as 
kindergarten teachers, the evaluation 
focused onthe community training of student 
nurses and midwives, and of the novices 
- young women who had been received into 
the house of the Medical Mission Sisters 
but who had not yet taken their vows. 


A number of different evaluation tools were 
used, including both individual and group 
interviews, and focus group discussions. The 
students and novices participated actively, 
particularly in the group interviews about their 
training for community health. They answered 


' "key" questions while a facilitator arranged 


their answers in table form on the blackboard. 


5 Analysing the data collected, reaching 
conclusions ("findings") and producing 
recommendations 

With the questionnaires of the maternal and 
child health survey complete, the long and 
arduous task of pulling together and analysing 
the results of the maternal and child health 
survey began. Ateam of ten, working in rotation, 
in the urban health centre and of six in the rural 
community health centre each took more than 
two days to count the results and to present 
them in the form of tables. One member of 
each team drew empty "dummy" tables on the 
blackboard to receive the data and totals, and 
then to work out percentages, averages and 
ratios, as necessary. Both teams used pocket 
calculators. 


The team at the rural health centre in Maner 
had eight deliveries to attend to during the 
same period in which the data analysis was 
taking place. Fortunately, all births were normal, 
and despite the interruptions and the long 
working hours, the team completed the tasks 
of data analysis, conclusions and recommen- 
dations. 


Drama presentations often attract large audiences of all ages in India. 
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Some surprises from the MCH survey, 


Patna 1988 
Urban Rural 

441 female respondents aged 15-49 years n=224 n=217 
. Never used any family planning method 83.9% 86.6% 
. Never received any antenatal care 37 .0% 86.6% 
140 children, aged 1- 4 years 
. Mid upper-arm circumference 

- in red section 20 % 19 % 

- in yellow section 22 % 34 % 
Socio-economic factors 

z . Average number of household members 6.9 7.1 

ki . Average number of rooms in house 1.9 eel 

3 . Family members owning warm clothes 37 ~% 50 % 

z . % of 36 urban and 42 rural families 

é who could not repay loans 66.7% 73 0% 

z .Main problems 

s (164 urban families and 174 rural families) 

& Lack of money 80.4% 72.4% 
: Lack of employment 64.0% 48.0% 
Tables were drawn on the blackboard to : 
receive the survey results. Alcoholism 18.9% 2.2% 

Housing 45.7% 14.1% 


Source: MCH Survey, Urban and Maner Health Centres, 


By the time all the results were tabulated, most 
team members considered the survey to have 
been worthwhile. In fact, those staff members 
who had been most against it at the start were 
among those who quoted the survey findings 
most frequently. 


Poor maternal healthcare : 

Some of the survey findings were surprising 
and, in’some cases, even shocking. For 
example, among 217 women interviewed in 
the rural area, more than 85% had received no 
antenatal care. A similar proportion had never 
used family planning. (See Some surprises 
from the MCH survey). 


Results such as these caused anxiety. "If this 
is the situation in the villages where we have 
been working, the situation must be much 
worse in other villages," said one concerned 
team member. 


The school health evaluation provided some 
small-scale but useful data for the evaluation. 
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Table MCH/U2 -9 and 11, and Tables MCH/M2 - 9 and 11. 


For example, it was clear that some children 
were seriously underweight. The evaluation 
also showed that the children’s knowledge of 
the causes of common health problems was 
poor. For example, half of the children in the 
rural school did not connect flies and contami- 
nated food with diarrhoea. — ; 


Although pleased with the achievements of the 


school health evaluation, the team working in 
the two schools in the urban area were 
concerned by the absence of girls in the class- 
rooms. Girls growing up in urban areas are 
often expected to care for younger children 
and livestock or to become "rag pickers" 
collecting waste paper, plastic or tins to sell by 
the kilo. It was therefore decided that some 
out-of-school activities should be planned to 
reach the children-who do not attend school. 


Bribery and illegal practices 

The conclusion of the evaluation of the 
government welfare schemes was thatalthough 
the activities were helping to link people with 
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the government schemes, more attention 
needed to be given to preventing bribery and 
illegal bank practices and to understanding 
how those families living in extreme poverty 
might be better able to benefit from the schemes. 


One conclusion of the evaluation of the work 
with milk cooperatives was that more training 
in book-keeping, writing business letters and 
leadership should be made available so that a 
larger network of people could be drawn upon 
to develop milk and other cooperatives. _ 


The focus group discussion with bonded 
labourers revealed that, as a result of new 
awareness, the landlords were more willing to 
release workers. However, this did not mean 
that these men could necessarily find jobs and 


homes. What was needed was more support 


for these men on their release. Otherwise, 
some were forced to return to the very land- 
lords from whom they had been set free. 


Youth and women: a future priority 

Even though the youth drama and the women’s 
activities programmes had faced problems, 
both were considered to be very important 
areas for the continuing and future success of 
the overall programme. 


_As part of the process of analysis and recom- 
mendation, discussion of programme 
Organization and management revealed the 
need to incorporate additional monitoring and 
evaluation procedures into future programme 
activities. Programme record-keeping would 


Bete oS ee oe aM 


Many young prople, particularly girls, were expected to go 
“rag picking” in the rubbish heaps rather than attend 
school. 


Phote: Marle-Théréss Feuerstein 


Several women had been able to attend training 
programmes as a result of the community health 
programme. 


have to be partly redesigned, and monthly 
monitoring meetings would be held. 


Staff also recognised that there was a need to 
redefine appropriate target areas. For example, 
the Maner Community Health Centre was 
especially active in 15 villages, with a population 
of between 1,000 and 3,000 in each. The large 
size of this population compromised the 
programme’s ability to follow-up all the social 
Support activities. Management and 
organization of the health activities, however, 
appeared to be working well. 


During the evaluation, analysis of 
programme costs and expenditures also 
took place, and the team decided that greater 
contact with other health and development 
programmes in India would be useful. 


The "social cement" of the programme 

Although several criticisms of the community 
training programme were voiced, such as 
rapid student turnover, most felt that it was 
the presence of the students and novices in 
the villages during training that contributed 
"social cement" for the entire community 
health programme. Although the majority of 
the general nurses would not subsequently 
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“Flannelgraphs” showed that only three in every ten women 
were receiving antenatal care. 


be working outside a hospital setting, it was felt 
that their community training would enable 
them to give better and more realistic patient 
care in hospitals. At the community level, 
villagers in the programme did not generally 
know who were staff and who were students. 


The commitment and affection shown towards 


the villagers by the novices, who spent several 
months actually living with Dalit families, was 
singled out for special mention. During their 
community training, the novices took their turns 
in fetching water, carrying out household tasks 
and harvesting rice. 


Both teams produced a list of recommenda- 
tions. The urban group produced 15 
recommendations and the rural group 18. They 
were short and practical, and emerged directly 
from analysis and discussion of the evaluation 
findings. However, each set of recommend- 
ations took a considerable length of time to 
secure because it was essential to achieve a 
consensus. Without full agreement, the group 
commitment needed for implementing the 
recommendations would be weak. 


Even before the evaluation process was over, 


members of the team were exhibiting a new 
enthusiasm towards their programme. "This 
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experience has helped us see that our work is 
bearing fruit," one member of the evaluation 
team said. 


They also felt that the participatory evaluation 
approach had stimulated interest in the 
community itself and created a new closeness 
between the programme staff and those it was 
trying to reach. "I feel that | now know the 
village women in a deeper way," said another 
team member during one of the closing 
sessions. At the conclusion of the evaluation, 
the team's hope was that the new closeness 
and understanding would strengthen the 
continuing programme. 


6 Preparing the report in forms suitable for 
sharing with various groups 
Each section of the report had been prepared 
by different individuals or groups from within 
the evaluation team. Most members of the 
team had done nothing like that before. The 
facilitator assisted by carrying out some basic 
editing but she made every effort to keep as 


_ many of the original expressions and styles as 


possible. 


In retrospect, the evaluation team felt that it 
would have been better to have allowed more 
time for them to produce charts, posters and 
other visual aids to accompany their own part _ 
of the report. However, the full 68-page 
document was eventually typed, stencilled and 
bound in attractive, locally-produced covers 
which had been prepared in advance. 


7 Sharing the findings of the report 
Community members were invited to come 


_and hear about the findings of the evaluation. 


The interviewers in the urban area had 
specifically invited the women respondents to 
hear about the results. The response was 
overwhelming. More than 100 women arrived 
at the meeting room, some followed by 
protective fathers-in-law who sat on a mat at 
the back of the hall. 


The meeting was extremely lively and lasted 
three hours. Thanks to extensive preparation 


by members of the team, activities included 
awareness-raising games and songs, role play 
and picture-graphics - all of which included 
messages from the survey findings. In this 
way, the statistical results of the survey were 
turned into pictures and actions. 


For example, one member of the team had 
prepared "flannelgraph stories". From flannel 
material, she had cut out shapes of women in 
saris and stuck them on the board. In one story, 
three women were in red saris and seven 
women in green, showing that only 30% of 


village women were receiving antenatal care . 


(see drawing on opposite page). 


Some of the students had also composed an 
"Antenatal Song" which was sung loudly and 
with great enthusiasm by the women and 
_ members of the evaluation team. The lyrics of 
the song encouraged women to think about 
their needs during pregnancy, and especially 
about the need to seek antenatal care. 


The evaluation team presented a mimed role- 


play about the difficulties of a village woman 
during pregnancy and childbirth. This was the 
first time that a drama had been presented in 
this form. Many of the women discussed at 
length what they had seen in the role-play. 
Others remained silent, knowing that they were 
not allowed to speak in the presence of fathers- 
in-law who had accompanied them to this 
unaccustomed outing. 


A final three-day workshop brought together 
the evaluation team from the urban and the 
rural centres plus senior hospital officials and 
invited guests. | 


The purpose was to share and analyze all the 
results of the evaluation, and to decide which 
recommendations should be for short-term, 
and which for long-term, action. It was also an 
opportunity to make a general plan of the 
programme's work for the coming year, and to 
decide on a schedule for the next evaluation. 


The evaluation experience made members of the health team feel that their work was bearing fruit. 
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8 Putting the recommendations into 
practice in the on-going programme 


1993 FOLLOW-UP 


This section is based on a report from Sister 
Grace Pullumakal who wrote to CMC earlier 
this year with reports from. the Urban and 
Maner Community Health Centres. 


In January this year, hospital administrator 
Sister Grace Pullumakal reported that the hopes 
of those involved in the participatory evaluation 
were being realised. Today, the community 
health programme is flourishing. "More and 
more people are fighting for their rights. They 
are now very aware of the need for education 
and immunization,for example,” she says. 


Sister Grace says that a clear sign of the new 
community orientation at the urban clinic is the 
fact that it has been renamed. "We now call it 
the Community Health Centre Kurji instead of 
the Urban Health Centre." 


f 


Greater community participation is made possible by 
more support for women's activities. 
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Community training programmes are now better planned and 
novices (shown here) continue to be popular with the Dalit 
families with whom they live. 


Focus on women 

But the changes go far deeper than the change 
of name. In both Kurji and Maner, the greater 
recognition of the need for participation has 
created anew focus on women’s development. 
Itis now recognised that without specific efforts 
to support women, little progress can be made 
in increasing community participation. Maner 
has opened three women’s literacy centres, 
and at Kurji, health education sessions are 
included in regular sewing classes. 


A priority at both of the health centres is the 
immunization programme. Tremendous strides 
have been made over the four years since the 
evaluation in 1988. That year, the survey 
revealed that in the Maner catchment area only 


17% of the children aged six months to five 


years were fully immunized. The follow-up 
report, written earlier this year, shows that two- 
thirds (66%) of the children under five years old 
are now fully immunized. 


It has proved much more difficult to increase 
attendance at antenatal and postnatal clinics. 
Instead, the health staff at both Kurjiand Maner, 
make a special effort to give attention to the 
mothers when they come to the clinics with 
their children. In Maner, there is an additional 
scheme in which two or three people in each 
village are asked to keep an eye on pregnant 
and lactating women, and to report any cases 
that might need follow-up by health staff. 


The school health programmes in both areas 
continue to be very successful. In Kurji, the aim 
is now to extend the Child-to-Child approach to 
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‘all schools in the catchment area. The 


programme has found that the interest and 


_ cooperation of the school principal is very 


important to their efforts. 


The youth drama programme is back in full 
force. Last year, there were 150 performances 
in Maner, many of which helped people to 
understand their situation better and to seek 
solutions. In Kurji, the theatre’s message has 
concentrated on the need for education. Drama 


performances and meetings in one area led. 


people of four villages to get together to build 
a straw room for a school. Afterwards, they 
hired a teacher and are now nen paying 
his salary. 


Schools for 
rag pickers" 


Support activities 
include organizing 
discussion groups 
about government 
welfare schemes and 
support for a milk 


new. projects. in 
community partici- 
pation for safe water 
and non-formal edu- 
cation for women and 
children. In Kurji, there 
are now five non-. 
formal schools for 
drop-outs and for the 
"rag pickers" WHO photo: marie-Thérese Feuerstein 
otherwise miss school 

because they have to do their work in the 
mornings. Parents value these non-formal 
schools not only because of the education their 
children receive but because it helps keep the 
children from becoming involved in drinking, 


drug taking and other addictive habits. 


The programme is associating more with other 
voluntary groups. The centres have worked 
with UNICEF on their immunization 
programmes, and with several women’s 
organizations. 


Lalti has contributed a great deal to the community health programme 
since the evaluation, and has done well personally. 


Much has also been achieved in the area of 
training. For example, at the Kurji Community 
Health Centre, there is now a better-planned 
programme for the nurses and midwives during 
their time spentin the community. The students 
become actively involved in surveys, case 
studies, street dramas and also in the village 
meetings where the important plans are made, 
and decisions taken. 


Lalti's story 

Finally, an individual example of personal 
success since the participatory evaluation in 
1988, is the experience of a Dalitwoman called 


Lalti. She had been a very enthusiastic 


participant during the evaluation which took 
place in her home village of Binteoli. She was 
identified at that time 
by members of the 
evaluation team as a 
possible future leader 
for women in her own 
community. 


With the follow-up 
report sentto Contact 
earlier this year, 
Sister Grace told us 
that ever since Lalti 
took part in the 
evaluation and feed- 
back session, she has 
been very active in 
stimulating 
community initiatives 
inherown village. Her 
involvement in the 
community health 
programme has helped her grow in self- 
confidence and ability. Lalti now has regular 
employment as a daiin private practice. Sister 
Grace says that Lalti’s employment takes her 
enthusiasm for community participation and 
development beyond the limits of her own 
village. Sister Grace concludes: "With her home- 
visiting, Lalti now reaches out to many." 
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USEFUL PUBLICATIONS 


Partners in Evaluation - Evaluating devel- 
opment and community programmes with 
participants 


This book was written by Marie-Thérese 
Feuerstein who also contributed "The Patna 
Experience" presented in this issue of Contact. 
She is a freelance consultant with 15 years 
experience in international health and 
participatory evaluation. 


The publication is both a practical field handbook 
and a textbook. Itis designed to help those who 
want to Know more about how to monitor and 
evaluate their own work. The methods, 
principles and examples it contains can be 
used in many different types of programmes 
but they are particularly appropriate to 
.development and community programmes. 


Many available monitoring and evaluating 
methods are inappropriate and too complex 
and costly for development and community 
programmes. This book advocates the partici- 
pation of the people at community level in 
various parts of the evaluation process. 


The book is published by MacMillan in English. 
It is also available in Portuguese (Brazilian), 
Arabic and Vietnamese. An edition in French is 
planned. A single copy costs £3.75 (including 
postage), and £2.95 for each of four or more 
copies. It is supplied through TALC. 


TALC 

PO Box 49 

St Albans 

Herts AL1 4AX 
United Kingdom. 


Testing and evaluating manuals - Making 
health learning materials more useful 


The authors of this slim manual say that the 
recent boom in the production of health learning 
materials means that many more, but not 
necessarily better, health manuals are now 
available. This publication aims to help health 
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workers to decide on which manuals are most 
appropriate for their use. It is easy to read and 
takes the readers through various tests which 
help to assess and guide adaptation to fita — 
local situation. 


The manual was produced at the Royal Tropical 
Institute in Amsterdam, in collaboration with 
the Health Learning Materials Programme of 
the World Health Organization, and with the 
help of experienced people in this field working 
in Africa and Asia. 


Copies are available at a price of US$6.50 
from: 

TOOL 

(Transfer of Technology for Development) 
Sarphatistraat 650 

1018 AV Amsterdam 

The Netherlands. 


Making health-care equipment - Ideas for — 
local design and production 


Published by part of the UK Intermediate 
Technology Development Group, this book 
describes how a great deal of the basic but 
important equipment upon which health 
services in developing countries depend can 
be made locally without sophisticated or capital- 
intensive equipment. 


The book argues that not only can health 
equipment be made locally but that there are 
several good reasons why it should be. The 
equipment will be more appropriate, for 
example. Local design means a design specific- 
ally for local needs and conditions, and with the 
involvement of the users. It will also mean that 
the equipment is cheaper, will not require for- 
eign currency and will be easier to maintain. 


Design and production details are given for the 
following equipment: hospital furniture; 
tricycles, wheelchairs and carts; physiotherapy 
and orthopaedic equipment, such as parallel 
bars and calipers; laboratory equipment; and, 
maternity and infant care equipment, such as 
a suction pump for newborn infants and a 
squatting chair for delivery. 


The book is available at a price of £5.95 (plus 
25% for postage and packing). Bulk discounts 
for orders of more than 10 copies are available. 


For copies, please write to: 
Intermediate Technology Publications 
103-105 Southampton Row 

London WC1B 4HH 

United Kingdom. 


Health Education Literature 


Abooklet entitled Health Education Literature 
is designed to provide easy access to important 
health education and health care literature 
available from the Christian Medical Association 


of India (CMAI). Among CMAI’s own new ~ 


publications are titles such as Family Life and 
The Church’s Healing Ministry in India. CMAI 
also distributes publications and newsletters 
on behalf of other publishers. Books in this 
category include Helping health workers learn 
by David Werner and Bill Bower, and Where 
there is no doctor by David Werner, available 
in English and Hindi. Newsletters include 
AHRTAG newsletters (Dialogue on Diarrhoea, 
CBR News and AIDS Action) and our own 
publication, Contact. 


For a copy of this catalogue, please write to: 


Christian Medical Association of India 
Plot 2, A-3, Local Shopping Centre 
Janakpuri, New Delhi 110058 

India. 


Library package 


Teaching-aids at low cost (TALC) has just 
announced a scheme which makes small 
libraries of vital medical books available. The 
first library is for district hospitals. It contains 17 
books, including two on primary surgery, an 
AIDS handbook and the latest book on 
tuberculosis. It costs £85, including postage 
and packing by surface mail worldwide. The 
second, aimed at district health workers, has 
14 books including Where there is no doctor, 
a revised book on nutrition and a book on 


_ obstetric emergencies. It costs £60, including 


postage and packing by surface mail worldwide. 


Further details are available from TALC (see 
address on opposite page). 


LETTERS 


Popular communication for health 

| was interested to see Contact 130, April 1993, 
and enjoyed reading it. It makes some very 
useful points about communication for 
promoting change. 


A couple of points come to mind. In the box on 
"Popular education" (page 2), may | suggest 
that the starting point is not just the "concrete 
experience of the learner” but also an 
expectation that others have something to 
teach? In participating in an inter-church group, 
| recall the breakthrough came when people 
positively expected to learn from others. Earlier, 
they had been content to focus only on their 
own experiences and input. 


The other thought relates to the extract from 
Streetwize on page 22. The illustration is all 
about health rights. It may be that the rest of the 
comic depicts the responsibilities young people 
have at particular ages. However, it is my 
observation that we spend a lot of time and 
energy on human rights in various contexts 
without mentioning the human responsibilities 
which are mutual and reciprocal. 


Where a relationship is skewed, there may be 
greater need for the exercise of one function or 
the other. Neither should be overlooked. If we 
hope to encourage and facilitate healthy 
relationships, | believe that we should present 
a balance in which both responsibilities and 
rights are part of the picture. 


Helen M Bichan 

Health Programme 
Commonwealth Secretariat 
London, UK. 
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‘Essential drug information 

We are two nurses working in an isolated area 
of Ethiopia. Transport to this place is very 
difficult. We get medicines in bulk and we have 
to use them to the full. We are therefore very 
interested in receiving a copy of an article 
published in Contact which contained 

information about expiry of medicines. 


Svan der Graaf 
Addis Ababa 
Ethiopia. 


Ed: Contact 107, February 1989, entitled 
Essential drugs: A convincing concept 
included CMC Guidelines on Drug Donations 
and the WHO Model List of Essential Drugs, 
5th Edition 1988. 


ANNOUNCEMENTS 


We are pleased to inform our readers, especially 
those in Eastern Europe, that with the 
assistance of Health Action International (HAI), 
we now have guidelines on drug donations in 
Latvian and Lithuanian. These can be obtained 
from CMC (see address below) or from HAI. 


Health Action International 
HAI-Europe 

Jacob van Lennepkade 334-T 
1053 NJ Amsterdam 

The Netherlands. 


In Memoriam 


It is with sadness that we announce that James C. 
McGilvray, Christian Medical Commissions first 
director (1968-1976), died on 6th August 1993 
at the age of 82 years. Until the last, he 
maintained the spirit of “health and wholeness” 
that he had advocated throughout his life. Only 
a few weeks before his death, he was in contact 
with CMC to express his concern for its well- 
being and to remind us all that this year the 
organization was 25 years old. 


James McGilvray was born and educated in the 
UK and began his career as the hospital 
superintendent of the Christian Medical College, 
Vellore, South India. Later he worked as a 
hospital administrator in the USA and then 
moved to the Philippines where he organized 


the first church-related health agency, linking all 
church-related institutions and programmes for 
joint planning and coordinated action. After- 
wards, having moved back to the USA, he 
organized a worldwide survey of church-related 
medical programmes. 


It was with the help of the findings of this survey 
that James McGilvray developed a critique of 
the western health care approach that was to 
contribute in a major way to the development of 
the ideals of primary health care, later propa- 
gated at the WHO's Alma Ata meeting in 1978. 
By the time he left CMC, he had also set in 
motion CMC's programme for health and healing, 
encouraging participation from all parts of the 
world and responding to the human need for 
wholeness in order to achieve health. 
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